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CHAPTER III 


Roots of Equations 


The objective of this chapter is to introduce methods to solve linear and 
non-linear equations. We will see how do these methods work and compute 
their errors. 


I. GRAPHICAL METHODS 


This is the simplest method to determine the root of an equation Ax =0. 
The procedure is quite straightforward: 


- Plot the function Ax 
- Observe when it crosses the x-axis, this point represents the value for which 


Ax =0. 


Note 1: This will provide only a rough approximation of the root. 
Note 2: you can remark that the function has changed sign after the root. 


Y =x) 


Figure.3.1. graphical method. 


However, this rough approximation of the root can be used as a first guess for other 
more accurate techniques. 
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BRACKETING METHODS 


Il. Bisection method 


One of the first numerical methods developed to find the root of a nonlinear equation 
f(x) =0 was the bisection method (also called Binary-Search method). The method 
is based on the following theorem: 


Theorem: An equation 7(.x) =O, where Z{¥ is a real continuous function, has 
at least one root between x, and x, if f(x) f-x,) <O ( Figure 3.2). 


Note that if f(x) f-x,) > 0, there may or may not be any root between x, and 


X, (Figures 3.3 and 3.4). If f(x) Ax,)< 0, then there may be more than one 


root between x, and *,, (Figure 3.5). So the theorem only guarantees one root 
between x. and X... 


Since the method is based on finding the root between two points, the method falls 
under the category of bracketing methods. 


Lx) 


Figure.3.2. At least one root exists between two points if the function is real, continuous, and changes 
sign. 
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LX) 


Figure.3.3. If function (xX) does not change sign between two points, roots of (xX) =O may still 
exist between the two points. 


ix) 


Figure.3.4. If the function L(x) does not change sign between two points, there may not be any roots 
£(.X) =O between the two points. 
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LX) 


Figure.3.5. If the function £(.X) changes sign between two points, more than one root for F(X =O 
may exist between the two points. 


A general rule is: 


- If the f(x:) and f(xu) have the same sign ( Ax ) Ax,) > 0): 
- There is no root between x; and xu. 
- There is an even number of roots between x; and Xu. 


- If the f(x.) and f(xy) have different signs ( f(x) fU-x,) < 0): 
- The is an odd number of roots. 


Exceptions: 


- Multiple roots 


Y=) 


Figure.3.6. Multiple roots. 
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Example: AV =x% +x - 5x43 NY =(x4+3)(x 1)” 


- Discontinuous functions 


X uj 


Figure.3.7. Discontinuous function. 


The steps to apply the bisection method to find the root of the equation f(x) =O 


are: 


Choose X% and ¥, as two guesses for the root such that A(x) f(x,) <O, or 
in other words, f(x) changes sign between x, and ¥,. 
Estimate the root, ¥,, of the equation f(x) =O as the mid-point between 
X, and ¥, as 
XxX, = Xp 5 Xa 
Now check the following 
a. If Ax) Xn) <0, then the root lies between x, and -X,,,; then 
X% =X and X, = Xr 


b. If f(x.) f(x,,) > 0, then the root lies between -X,,,and ¥,; then 


zz 
x, = X,,and x, = X; $ 
c. If f(x) Xn) =0; then the root is X, Stop the algorithm if this is 
true. 
Find the new estimate of the root 
X+tX 
Xn = 2 = 
Find the absolute approximate relative error as 


ew_ Id 
Xa -Xna | x10C 


E | S| a 
| a ew 
22 


Xz” = estimated root from present iteration 


x = estimated root from previous iteration 


In 


Compare the absolute relative approximate error [Eal with the pre-specified 


relative error tolerance €... Ifle.| >e,, then go to Step 3, else stop the 


algorithm. Note one should also check whether the number of iterations is 


more than the maximum number of iterations allowed. If so, one needs to 
tarminatea thea alanrithm and notify the icer ahniit it 
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Example 


A ball has a specific gravity of 0.6 and has a radius of 5.5 cm. What is the 
distance to which the ball will get submerged when floating in water? 


The equation that gives the depth ‘x’ to which the ball is 
submerged under water is: 


LV- NTA 4+ 200%104 =N 
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11.2. Advantages and drawbacks of the bisection method 


HW.2.1. 


a) 


b) 


H.2.2. 


and x, 


Advantages of Bisection Method 


The bisection method is always convergent. Since the method brackets the 
root, the method is guaranteed to converge. 


As iterations are conducted, the interval gets halved. So one can guarantee 
the decrease in the error in the solution of the equation. 


Drawbacks of Bisection Method 


The convergence of bisection method is slow as it is simply based on halving 
the interval. 


If one of the initial guesses is closer to the root, it will take larger number of 
iterations to reach the root. 


If a function Z(¥) is such that it just touches the x-axis (Figure 3.8) such as 
xa x =0 

it will be unable to find the lower guess, X; , and upper guess, -X,,, such that 
Ax) %,) < 0 

For functions (xX) where there is a singularity? and it reverses sign at the 


singularity, bisection method may converge on the singularity (Figure 3.9). 
An example include 


ee 


X 
=- 2, X, =3are valid initial guesses which satisfy 


FX) EX) < 0. 


However, the function is not continuous and the theorem that a root exists is also not 
applicable. 


1 A singularity in a function is defined as a point where the function becomes 
infinite. For example, for a function such as 1/x, the point of singularity is x=0 as it 
becomes infinite. 
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od * X 


T T T T 


Figure.3.8. Function Áy = xX =Ohas a single root at x= Othat cannot be bracketed. 


f(x) 


1 
Figure.3.9. Function Ax =— =Q has no root but changes sign. 
X 


lll. False position method 


A shortcoming of the bisection method is that in dividing the interval from x, to x, into 
equal halves, no account is taken of the magnitude of f(x;) and f(x.). Indeed, if f(xi) is 
close to zero, the root is more close to x, than xo. 


The false position method uses this property: 


A straight line joins f(xi) and f(xu). The intersection of this line with the x-axis 
represents an improvement estimate of the root. This new root can be computed as: 
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Ax) _ Ax) 
MA. RK, 


' -y Axlly- x) 
Giving xX. =X, Ax- Ax) 


This is called the false-position formula 


Then, x, replaces the initial guess for which the function value has the same sign as 
F(x;) 


F(X A 


F(x, 


Figure.3.10. False-position method. 


The difference between bisection method and false-position method is that in 
bisection method, both limits of the interval have to change. This is not the case for 
false position method, where one limit may stay fixed throughout the computation 
while the other guess converges on the root. 


f(x A 
Ill.1. Pitfalls of the fajse{position method 
Although, the false position method is an Roy ent of the bisection method. In 


some cases, the bisection method will converg# faster and yields to better results 
(see Figure.3.11). 
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Figure.3.11. Slow convergence of the false-position method. 


IV. Modified false position method 

As the problem with the original false-position method is the fact that one limit may 
stay fixed during the computation, we can introduce a modified method in which if 
one limit is detected to be stuck, the function value of the stagnant point is divided 
by 2. 

V. Incremental searches and determining initial guesses 

To determine the number of roots within an interval, it is possible to use an 
incremental search. The function is scanned from one side to the other using a small 
increment. When the function changes sign, it is assumed that a root falls within the 
increment. 

The problem is the choice of the increment length: 


Too small very time consuming 
Too large some root may be missed 


The solution is to use plotting or information from the physical problem. 


OPEN METHODS 
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Bracketing methods use two initial guesses and the bounds converge to the solution. 
In open methods, we need only one starting point or two (that not necessarily 
bracket the root). 

These methods may diverge, contrary to the bracketing methods, but when they 
converge, they usually do it much more quickly than bracketing methods. 


VI. Simple fixed-point method 


In open methods, we have to use a formula to predict the root, as an example for the 
fixed-point iteration method we can rearrange f(x) so that x is on the left-hand side of 
the equation: 


x=Gx 


This can be achieved by algebraic manipulation of by simply adding x to both sides of 
the original equation, example: 


1- x 
3 
sity =0 x=sin®+x 


¥+3x-1=0<¢e x= 


This is important since it will allow us to develop a formula to predict the new value 
for x as a function of an old value of x: 


Xa = Gx) 
VI.1. Convergence 


Vil. Newton-Raphson method 


Newton-Raphson method is based on the principle that if the initial guess of the root 
of f(x)=0 is at x;, then if one draws the tangent to the curve at f(x;), the point Xi+ı 
where the tangent crosses the x-axis is an improved estimate of the root (Figure 
3.12). 


Using the definition of the slope of a function, at x= x; 


L(x)- O 
i AG 
which gives 


L(x) 
This equation is called the Newton-Raphson formula for solving nonlinear equations 
of the form Ax =0. So starting with an initial guess, xi, one can find the next 


guess, Xi+i, by using the above equation. One can repeat this process until one finds 
the root within a desirable tolerance. 
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Sir Isaac Newton, (4 January 1643 - 31 March 1727) [ OS: 25 
December 1642 - 20 March 1727] was an English physicist, 
mathematician, astronomer, alchemist, and natural philosopher, 
regarded by many as the greatest figure in the history of science."2! His 
treatise Philosophiae Naturalis Principia Mathematica, published in 
1687, described universal gravitation and the three laws of motion, 
laying the groundwork for classical mechanics. By deriving Kepler's 
laws of planetary motion from this system, he was the first to show 
that the motion of objects on Earth and of celestial bodies are 
governed by the same set of natural laws. The unifying and predictive 
power of his laws was integral to the scientific revolution, the 
advancement of helincentrism. and the hroader accentance of the 


Joseph Raphson was an English mathematician known best for the Newton-Raphson method. 
Little is known about Raphson's life- even his exact birth and death years are unknown, though 
the mathematical historian Florian Cajori supplied the approximate dates 1648-1715. Raphson 
attended Jesus College in Cambridge and graduated with an M.A. in 1692. Raphson was made a 


Fellow of the Royal Society in 30 November 1689 after being proposed for membership by 
Edmund Halley. 


Raphson's most notable work was Analysis Aequationum Universalis which was published in 
1690. It contained the Newton-Raphson method for approximating the roots of an equation. 
Isaac Newton developed the same formula in the Method of Fluxions. Although Newton's work 
was written in 1671, it was not published until 1736- nearly 50 years after Raphson's Analysis. 


Algorithm 
The steps to apply using Newton-Raphson method to find the root 
of an equation f(x) = 0 are 
1. Evaluate f'(x) symbolically 
2. Use an initial guess of the root, xi, to estimate the new 
value of the root Xi+ı as 


Xna 


1 


Find the absolute relative approximate error, |£ |as 


le. 


Xn ¥ x10 


+1 
Compare the absolute relative approximate error, |£ | with 


the pre-specified relative error tolerance, €,. If |e > £s, 


then go to step 2, else stop the algorithm. Also, check if 
the number of iterations has exceeded the maximum 
number of iterations. 
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fly) 


A 


HXi) 


Figure.3.12. Geometrical illustration of the Newton-Raphson method. 


Example 


Solve the same problem for the floating ball using Newton-Raphson method. 
Find: 


a) the depth ‘x’ to which the ball is submerged under water. Conduct 
three iterations to estimate the root of the above equation. 
find the absolute relative approximate error at the end of each iteration. 


VI.1. Drawbacks of Newton-Raphson Method 
- Divergence at inflection points: If the selection of a guess or an iterated value 


turns out to be close to the inflection point of f(x), that is, near where f”(x)=0, the 
roots start to diverge away from the true root. 
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HA foD 


Figure.3.13. Divergence at inflection point. 


- Division by zero or near zero: The formula of Newton-Raphson method is 
KX 
Xiri =X; 5 a) 
L(x) 


Consequently if an iteration value, æ; is such that f(x) =0, then one can face 


division by zero or a near-zero number. This will give a large magnitude for the next 
value, Xi+1. An example is finding the root of the equation 


AX =x 0080 +24x10° 
in which case 

f(x =3¥ - 006x 
For % =O or X% =0.02, division by zero occurs (Figure 3.14). For an initial guess 
close to 0.02, of xæ =0.0199', even after 9 iterations, the Newton-Raphson 
method is not converging. 
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Number | Sd 

Number 

0.019990 

-2.6480 

-1.7620 

-1.1714 

-0.77765 

-0.51518 ; 
-0.34025 : -0.042862 
-0.22369 : -0.012692 
-0.14608 ; -0.0037553 
-0.094490 ; -0.0011091 


0 
1 
2 
3 
4 
5 
6 
7 
8 
9 


Figure 3.14. Division by zero or a near zero number. 


- Root jumping: In some case where the function f(x) is oscillating and has a 
number of roots, one may choose an initial guess close to a root. However, the 
guesses may jump and converge to some other root. For example for solving the 
equation 

sinx=0 

if you choose X% =2.47 =(7.53982). as an initial guess, it converges to the root 
of x=0 as shown in Table 3. However, one may have chosen this an initial guess to 
converge to x=27 =6283186E. 
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Iteratio 
n 
Number 
0 7.539822 0.951 


4.461 -0.969 
2 0.5499 0.5226 
3 -0.06303 -0.06303 
4 6.376x10% 8.375x10% $ 
5 -1.95861x10} | -1.95861x10? | 4.27x10'° 


f(x) 


~ + 


-0.0630 05499 


Figure 3.15. Root jumping from intended location of root for Áx =sinx=0 


- Oscillations near local maximum and minimum: Results obtained from 
Newton-Raphson method may oscillate about the local maximum or minimum 
without converging on a root but converging on the local maximum or minimum. 
Eventually, it may lead to division by a number close to zero and may diverge. 


For example for 
Ax =x +2=0 


the equation has no real roots 


300.00 


128.571 
- . 476.47 
0.30357 ; 109.66 
3.1423 ; 150.80 
1.2529 ; 829.88 
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34.942 
9.268 
2.954 


21.75 l -0.3040 «= 0.5 i 2 3 3.142 


Figure.3.16. Oscillations around local minima for Ax =x +2 


VI.2. Additional features for Newton-Raphson 


- Plot your function to correctly choose the initial guess. 

- Substitute your solution into the original function. 

- Substitute your solution into the original function. 

- Substitute your solution into the original function. 

- Substitute your solution into the original function. 

- Substitute your solution into the original function. 

- Substitute your solution into the original function. 

- Substitute your solution into the original function. 

- The program must always include an upper limit on the number of iterations. 


- The program should alert the user of the possibility of f(y =0. 
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VII. The secant method 


The Newton-Raphson method of solving the nonlinear equation f(x)=0 is given by the 
recursive formula 


_ LC) 
he Pe) 


(1) 


From the above equation, one of the drawbacks of the Newton-Raphson method is 

that you have to evaluate the derivative of the function. With availability of symbolic 

manipulators such as Maple, Mathcad, Mathematica and Matlab, this process has 

become more convenient. However, it is still can be a laborious process. To 

overcome this drawback, the derivative, f'(x) of the function, f(x) is approximated as 
= Kx)- Kx) 


f(x) = ae (2) 
T ALY 


Fd P 


Substituting Equation (2) in (1), gives 


The above equation is called the Secant method. This method now requires two 
initial guesses, but unlike the bisection method, the two initial guesses do not need 
to bracket the root of the equation. The Secant method may or may not converge, 
but when it converges, it converges faster than the bisection method. However, 
since the derivative is approximated, it converges slower then Newton-Raphson 


method. 
The Secant method can be also derived from geometry shown in Figure (3.17). 


Taking two initial guesses, x; and Xi, one draws a straight line between f(x) and f(Xi-1) 


passing through the x-axis at Xi+ı. ABE and DCE are similar triangles. Hence 
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AB_DC 
AE DE 


> xX 


Figure.3.17. Geometrical representation of the Secant method. 


VII.1. Difference between the secant and false-position method 


In the false position method, the latest estimate of the root replaces whichever of the 
original values yielded a function value with the same sign as f(x,). The root is always 


bracketed by the bonds and the method will always converge. 


For the secant method, Xi+ı replaces x; and x; replaces Xj.1. AS a result, the two values 
can sometimes lie in the same side of the root and lead to divergence. But when, the 


secant method converges, it usually does it at a quicker rate. 
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Vill. Rate of convergence 


Figure (3.18) compares the convergence of all the methods. 


— 


True percent relative error 
ar 
Q 
N 


uosydey-uoməN 


20 


Iterations 


Figure.3.18. Rate of convergence of all the methods. 


Additional problems 
P I. Find the largest root of: 
MX =X - x-1=0 


Using the bisection method 
(Plot the function first to determine your initial guesses) 


Solution: x = 1.1328 
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Roots of Equations 
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